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SUMMARY 


\i 


The  general  problem  of  a  markaman  veraua  a  mobile 
target,  with  a  time  lag  In  the  gunner 'a  In^rroatXon^ 
aa  to  the  targct'a  poaltlon,  ^^p^ay»-l hominy  guiaLefH 
In  many  8itu^t4ona „ — Xt^-ia- -a-  olcaalo  wiilAtary  problem* 
Formulated  In  terma  of  game  theory,  the  dealderata 
are:  How  ahould  the  target  beat  maneuver  to  confound 
prediction  of  hla  poaltlon?  How  and  when  ahould  the 
markaman  make  thla  prediction?  What  hit  probability 
la  to  be  expected  when  both  partlclpanta  behave 
optimally? 

X. 

Ilila  paper  dlaouaaea  thla  general  claaa  of  problema 
and  then  aettlra  on  one  idilch  aeema  to  be  the  almpleat 
poaalble  exampl^  that  la  not  trivial.  Nevertheleaa 
It  la  difficult. \  In  two  prevloua  papera  devoted  to 
It,  the  evader 'a  \beat  atrategy  and  value  of  the  game 

wap#-glvaiL. _ Here^^he  emphaala  la  on  the  markaman. 

He  haa  no  optimal  atrategy,  but  doea  have  an  Ideal 
atrategy  with  the  property  that  every  near  optlmar  ^ 
atrategy alao  haa  a  claaa  of 
^  aaalve  t^^rft^cslea  auch  that  If  and  only  If  he 
obey  a  their  dlctatea  will  he  either  come  within  tc"  ] 
of  the  beat  hit  probability  or  elae  alwaya  remain 
In  a  poaltlon  where  It  la  poaalble  to  do  ao.  f'  j 

K 
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THE  PROBLEM  OF  AIMING  AND  EVASIOK 


Rufus  Isaacs 


1 .  Introduction 

One  of  the  most  classic  of  military  problems  Is:  how  best 
to  aln  at  a  mobile  target  which  Is  deliberately  maneuvering  so 
as  to  confound  prediction  of  his  position.  The  answer  must  be 
sought  In  the  theory  of  games,  whence  we  consider  simultaneously 
the  apposite  question:  how  best  should  the  target  maneuver. 

Such  antagonists  appear  In  a  great  variety  of  situations. 

They  may  be  sniper  against  Infantryman,  antiaircraft  gun  against 
plane,  bomber  against  ship.  Whatever  be  their  nature,  the  crucial 
feature  these  situations  have  in  common  Is  a  time  lag  between  the 
detection  of  the  target  and  the  arrival  of  the  projectile.  This 
lag  may  be  composed  of  a  number  of  summands  such  as  the  delay 
between  detection  of  the  target  and  aiming  of  the  firing  device, 
and  the  flight  time  of  the  projectile  Itself.  But  this  decomposi¬ 
tion  does  not  concern  us  here;  it  suffices  to  consider  the  time 
lag  as  a  whole. 

The  theory  of  games  warns  us  to  expect  mixed  strategies 
from  both  participants  and  a  modicum  of  common  sense  confirms 
the  warning.  When  a  player  of  a  game  employs  a  mixed  strategy. 

It  means  that  he  does  not  make  his  decisions  in  accordance  with 
any  predetermined,  certain  plan,  but  Invokes  a  certain  amount  of 
randomness.  A  game  theoretic  solution  prescribes  not  the  dictates 
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of  behavior  but  their  exact  probabilities  so  as  respectively  to 
minimize  or  maximize  the  probability  of  a  hit.  It  is  clear  that 
this  will  be  the  case  in  the  present  type  of  problem.  For  if  the 
target  were  to  follow  any  proscribed,  certain  plan,  it  would 
plainly  be  a  ruinous  policy  aa  soon  as  the  gunner  became  aware 
of  it.  Likewise  any  fixed  policy  of  the  gunner  would  enable  the 
target  always  to  escape  once  he  learned  it.  Then  our  goal  is 
optimal  mixed  strategies  or  policies  of  best  regulated  randomness 
for  each  player. 

So  far  as  we  know,  this  entire  field  is  virtually  virginal. 

We  do  not  claim  any  deep  inroads  here.  We  deal  with  a  single 
problem,  described  below,  which  is  the  simplest  nontrivial  one 
we  could  devise,  yet  which  embodies  the  features  discussed  above. 

It  is  but  the  first  rung  of  the  ladder. 

The  circumstances  that  led  to  this  problem,  we  think,  are 
instructive.  Originally  this  was  its  guise. 

A  battleship  in  midocean  is  aware  of  an  enemy  bomber's 
presence,  but  the  plane  is  too  high  for  precise  detection.  The 
ship  is  interested  only  in  not  being  hit;  it  has  no  offensive 
means.  The  plane  has  one  bomb  and  we  suppose  —  to  avoid  extra¬ 
neous  factors  —  that  the  bomber's  aim  la  excellent.  The  battle¬ 
ship  knows  this,  but  knows  nothing  about  when  or  where  the  bomb 
will  be  dropped  until  after  detonation.  It  is  to  maneuver  so  as 
to  minimize  the  hit  probability.  We  suppose  that  its  only  kinematic 
restriction  is  that  it  travels  with  a  fixed  speed  v.  There  is  a 
time  lag  T  between  the  bomber's  last  sighting  of  the  ship  and 
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detonation.  Thus  the  bomber  must  aim  at  an  anticipated  position 
of  the  ship. 

Oame  theory  attempts  to  answer  the  three  Interstlclal  questions 

How  best  should  the  battleship  maneuver?  (Optimal 
strategy  of  player  I) 

When  and  where  should  the  bomber  strike?  (Optimal 
strategy  of  player  II) 

What  Is  the  hit  probability  when  both  players  use 
beat  tactics?  (Valus  of  the  game) 

If  at  a  certain  time  the  ship  Is  sighted  at  a  certain  position, 
then  when  the  bomb  strikes  )ie  may  be  located  anywhere  In  a  disk  of 
radius  vT.  To  minimize  the  chance  of  an  Insnedlate  hit,  the  ship 
should  be  at  all  points  of  the  disk  with  equal  probability.  For 
If  he  favored  one  portion  of  the  disk,  by  bombing  thereat  the 
plane  scores  a  dlsparately  high  hit  probability.  But  there  Is 
only  one  path  —  a  straight  one  —  by  which  the  ship  can  reach  a 
peripheral  point  and  many  by  which  he  can  reach  a  given  Interior 
one.  Thus  to  achieve  equlprobablllty,  the  ship's  mixed  strategy 
must  attach  an  unduly  high  probability  to  straight  paths.  But 
plainly  such  a  course  Is  detrimental  to  future  positions.  For 
If  the  bomber  waits  a  little  and  observes  this  straight  path 
tactic,  nothing  could  be  easier  than  an  extrapolation  and  a 
certain  hit.  In  other  words,  if  the  ship  attempts  equlprobablllty 

For  peripheral  positions  we  should  make  a  correction  If 
we  take  any  Inaccuracy  of  bomber  Into  account.  We  will 
not  do  so  here. 


at  one  instant  he  renders  hla  later  distributions  extremely 
unequal.  The  battleship  must  compromise  between  present  and 
future  and  seek  a  probability  distribution  which,  although  It 
Is  as  near  uniform  as  possible,  can  be  maintained  Indefinitely. 

As  simple  as  this  problem  sounds  circumstantially.  It  Is 
difficult  technically.  To  gain  a  foothold,  we  slnq^llfled  It 
further.  We  made  the  ocean  one-dlirenslonal  and  discrete.  That 
Is,  we  supposed  the  battleship  to  be  located  on  one  of  a  long 
row  of  points  and  at  each  unit  of  times  he  hops  to  one  adjoining 
one,  enjoying  the  sole  choice  of  a  rl^t  or  left  Jump.  The  time 
lag  was  to  be  an  Integral  number  n  of  time  units,  or  —  the 
same  thing  —  of  Jumps.  This  Is  tantamount  to  saying  that  the 
bomber  knows  all  positions  of  the  battleship  which  precede  his 
present  one  by  n  Jumps  or  more.  If  n  -  1,  the  bomber  knows  all 
but  the  most  recent  of  the  ship's  positions  and  there  are  but  two 
possibilities  for  that:  one  space  to  right  or  left  of  the  last 
observed  one. 

This  case  —  n-1  —  Is  trivial.  The  ship  makes  each  decision 
left  or  right  —  by  the  toss  of  a  coin.  The  bomber  can  bomb  at  any 
time  and  when  he  does  he  also  decides  between  the  two  possibilities 
with  a  coin.*  Then  the  value  of  the  game  (hit  probability)  Is  1/2. 

(For  the  game  theory  tyro  only.  )  If  at  sosie  time,  the  ship 
elected,  sa>,  the  probabilities:  Left:  .6;  Right:  .4,  the 
bomber  need  only  wait  for  this  time  and  bomb  on  the  loft; 
then  hit  probability  -  .6.  Similar  considerations  hold 
vice  versa.  Thus  the  unique  optimal  strategies  require 
50-bO  decisions  on  the  parts  of  both  players. 
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Our  Intention  was  now  to  take  up  n  -  2,  3#  4,  •••  and,  from 
the  knowledge  gained,  proceed  to  the  continuous  case.  Ihence,  we 
hoped  to  restore  planarity  to  the  ocean  and  approach  practicality 
by  more  realistic  assumptions  about  the  ship's  kinematics,  accuracy 
of  the  bomber,  number  of  bomba,  etc. 

But  the  case  of  n  -  2  proved  to  be  an  incubus.  A  considerable 
amount  of  effort  by  several  people  was  expended  before  Its  shell 
began  to  crack.  This  paper  will  be  the  third  one  devoted  to  It; 
see  [l,  2],  W«  can  -xpect  the  general  class  of  aiming— end-evasion 
problems  to  be  more  difficult  than  anticipated,  but  by  no  means 
hopeless . 

We  have  been  occupied  with  a  subject  we  call  differential 
games,  ¥flth  pursuit  games  as  one  of  Its  more  cogent  applications. 

A  drawback  Is  the  difficulty  of  handling  oases  where  the  Information 
of  the  players  Is  Incomplete.  It  is  our  hope  that  the  present 
problem  will  adumbrate  techniques  in  this  field  also,  and  we  are 
thus  guided  In  our  nomenclature  of  the  players: 

P,  the  pursuer,  bomber,  or  marksman 
E,  the  evader,  battleship,  or  target. 

We  cite  one  Innovation  of  technique  that  appears  to  be  of  some 
generality  In  games  like  the  present  one  which  admit  of  a  "stationary” 
or  steady  state  character.  By  this  we  mean  that  after  a  full  cycle 
of  moves  (usually  one  by  each  player)  the  game  Is  either  terminated 
cr  a  situation  recurs  which  resembles  a  fresh  start  of  the  gasie. 

An  Initial  move  of  one  player  Is  replaced  by  a  chance  move  with  a 
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prcaislgned  probability  x.  Then  for  each  x  wa  have  a  nrw  game 
and  the  value  of  thla  game  we  denote  by  ^(x).  Often  the 
reaemblance  juat  mentioned  beoomea  an  Identity  except  for 
the  value  of  x,  which  circumstance  enables  us  to  write  a 
functional  equation  satisfied  by  ^(x).  For  a  simple  example 
of  this  method  —  the  Initial  one  for  us  —  see  our  paper  [3] 
dealing  with  a  recreational  game. 

In  the  previous  two  papers  [l,  2],  dealing  with  the  current 
game,  E  was  accorded  this  treatment  of  having  his  Initial  move 
"chanclfled. "  Here  we  shall  do  the  same  for  P.  Ihese  alter¬ 
native  possibilities  present  a  curious  duality  of  techniques 
whose  Interrelationships  may  bear  Interesting  fruit. 

But  methods  laterJ  Let  us  now  return  to  case  of  n  •  2  — 
our  subject  proper.  The  course  of  £  can  be  shown  conveniently 
on  the  diagram  of  Figure  1.  Hla  starting  point 
Is  0  and  on  hla  first  move  he  travels  to  either 
d  or  e.  If  he  went  left  to  d,  on  his  second 
move  he  may  go  to  a  or  b  and  so  forth. 

Always  P  knows  E  to  be  at  one  of  three 
positions;  If  he  was  last  observed,  say, 
at  d,  and  P  wishes  to  fire  he  will  do 
so  at  one  of  f,  g,  or  h. 

The  same  dllemsm  of  present  or  future 
benefits  that  beset  the  battleship  also  confronts  £,  but  we  are 
now  In  position  to  examine  matters  more  succinctly.  If  E  Is 
concerned  only  with  a  single  Instant,  his  best  and  safeat  course 
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la  to  make  the  three  probabilities  of  where  he  will  be  when 
under  fire  each  equal  to  1/5.  For  then  P  spots  him  with 
probability  1/5  and  this  Is  clearly  the  lowest  value  E  can 
can  hope  for.  Let  us  suppose  E  Is  guided  by  this  consideration 
alone. 

On  the  grounds  of  symmetry,  we  suppose  E  to  make  his  first 

# 

choice  (d  or  e)  with  probabilities  1/2.  To  cause  the  probablllti 
of  being  at  a,  b,  or  c  to  be  l/3»  E  must  make  his  second  move  with 
probability  2/5,  1/3,  1/3,  2/3  as  marked  on  Figure  1.  If  E  Is  at 
d  he  must  similarly  equalize  his  chances  of  arriving  f,  g,  or  h. 
llils  determines  some  of  his  third  move  probabilities;  they  are 
also  marked  on  the  figure.  But  the  probability  b— to-h  Is  II 
Thus,  should  E  reach  b  via  d,  P  can  fire  then  and,  by  splitting 
his  target  choice  between  J  and  k,  score  with  probability  1/2 
or  more. 

Let  us  endeavor  to  find  a  less  ambitious  but  more  enduring 
strategy  for  E.  We  may  expect  that  In  such  a  strategy  each 
decision  will  depend  on  prior  moves.  As  E's  course  more  than 
two  moves  ago  Is  known  to  his  opponent.  It  Is  reasonable  to 
suppose  that  this  dependence  will  not  reach  very  far  back.  Let 
us  suppose  the  choice  depends  on  the  previous  move  only.  Pre¬ 
cisely  let  E  move  In  the  same  direction  as  his  last  move  with 
probability  1  -  x  and  let  him  make  a  turn  with  probability  x. 

This  strategy  Is  certainly  stationary;  It  Is  expounded  In 
Figure  2,  which  diagram  applys  to  any  position  except  the 


« 


The  symmetrlza tlon  is  not  necessary.  The  reader  can  verify 
that  our  reasoning  holds  whatever  the  Initial  probability. 
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one  at  the  very  outBet. 
of  E'b  reaching  1,  2,  or 


(1-x)' 


X ( 1-x ) 


>  (1) 


I  -  K 

\ 

1 


In  accordance  with  the  tenets  of  game 
theory,  we  presume  that  P  will  elect  the  largest  of  these  three 
quantities.  The  beat  possible  x  for  E  Is  then  that  value  which 
renders  the  maximum  of  the  three  polynomlais  (1)  a  minimum. 
Plots  of  (1)  are  sketched  in  Figure  3  with  maximum  overscored. 
It  la  minimum  at  V,  a  root  of 


It  turns  out  that  V 


X  -  {1-^f  .  (2) 

Hien 

V  -  -  .382  •  •  •  .  (3) 

Itils  number  Is  also  the  probability 
E’s  arriving  at  points  1  or  2  and 
so  Is  the  payoff  when  E  plays  as 
Just  described  (we  grant  P  sense 
enoufi^h  not  to  fire  at  3)* 

Is  actually  the  value  of  the  game  and 


the  strategy  Just  described,  which  we  henceforth  denote  by  M, 
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l8  the  optimal  strategy  for  E  and  Indeed  the  only  such.  On  the 
other  hand,  It  turns  out  that  P  does  not  possess  an  optimal 
strategy,  the  situation  being  thus:  for  any  ^  >  0,  there  Is  a 
(mixed)  strategy  for  P  which  assures  him  of  a  hit  with  proba¬ 
bility  >  V  —  £,  but  no  strategy  Insures  V,  A  strategy  of  this 
type  will  be  called  a  near  optimal  strategy  or  an  £— strategy. 

Tliese  results  are  not  easy  to  prove.  Ihey  are  the  subjects 
of  papers  [l,  2].  Dublns  deserves  the  honor  of  priori  ;y.  His 
paper  came  to  our  attention  some  months  after  Its  publication. 

By  this  time  a  RAND  version  was  ready  for  the  press;  the  work 
was  done  Independently  and  the  methods  differed  enough  to  warrant 
8  second  treatment. 

Neither  paper  gave  a  near  optimal  strategy  for  P  In  the 
sense  of  furnishing  him  explicit  playing  Instructions.  As  this 
facet  of  the  problem  Is  of  obvious  Importance  In  more  realistic 
versions,  we  present  a  third  approach  which  stresses  this  aspect. 

On  this  topic  we  shall  later  obtain  the  following  results. 

In  the  next  section  our  game  will  be  Imbedded  in  a  family  of 
games.  For  these  games  P  has  what  we  term  an  ideal  strategy. 

It  Is  for  most  of  the  family  not  an  £— strategy,  but  It  is  true 
that  every  ^.-strategy  la  nearly  the  Ideal  strategy,  the  nearness 
Increasing  with  the  smallness  of  £ .  We  also  delineate  a  class 
called  passive  t-etrategles .  For  each  t  and  each  play  of  a 

« 

We  complete  the  definition  of  M.  On  his  verj-  first  move 

E  may  elect  any  probability  p  such  that  V  <  p  <  1  -  V. 

It  Is  easy  to  verify  that  P  can  still  attain  at  most  V. 
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game  these  impose  well-defined  restrictions  on  each  move  of  P 
such  that: 

If  he  conforms  he  will  either  attain  a  hit  probability 
exceeding  the  value  (the  beet  possible)  -t  or  he  will  always 
be  in  position  where,  with  proper  subsequent  play,  it  will  be 
possible  for  him  to  do  so.  But  if  ever  he  violates  the 
restrictions,  E  can  prevent  him  from  coming  with  t  of  the  value. 

The  ideal  strategy  la  a  passive  fc— strategy  for  every  i. 


2.  Itie  ”Chanclfled"  Games 


0 


We  say  P  plays  an  a— strategy  when  the  following  holds: 

Let  a  »  i/V5*  Whenever  P  ^ 

/ 

decides  to  fire  he  will  aim  at  the 
leftmost  [rightmost]  of  the  three 
points  where  E  may  be  with  proba¬ 
bility  a  if  E’s  last  observed  move 
was  left  [right]  and  he  aims  at  the 
center  point  with  probability  1  —  a. 

To  act  at  the  very  opening  of  the  game,  P  must  supply  E  with  a 
fictitious  preceding  move.  See  Figure  4,  where  the  dotted  line 
is  the  (possibly  fictitious)  preceding  move.  We  will  motivate 
this  concept  in  Section  7. 

We  coin  two  families  of  new 
games . 

our  original  rules: 

Ihere  is  a  fictitious  siinus- 
flrst  move,  say,  from  the  left,  and 

f-  ig .  5 


For  the  game  F^,  we  amend 


\ 


P-642 

-11- 


P  Is  constrained  to  play  an  o-atrategy.  'Hie  opening  move  Is 
chanclfled;  P  Is  libelled  to  fire  with  a  preassigned  probability 
r.  Also  S  Is  obliged  to  make  his  first  move  to  the  left.  (See 
Figure  5. ) 

llie  game  is  the  same  except  that 

* 

E  makes  his  first  move  to  the  ri^t. 

For  let 

r' 

f(r)  -  sup  Inf  (payoff) 


which  inf  extends  over  all  strategies  of 
E  and  sup  over  those  of  P.  Or,  to  put  It  ^ 

otherwite,  f(r)  Is  the  upper  bound  of  all 

hit  probabilities  that  P  can  attain  In  the  game  no  matter 
how  skillfully  he  Is  opposed. 

Let  h(r)  be  defined  analogously  for  H^. 

We  shall  obtain  a  pair  of  functional  equations  for  f(r),  h(r) 

Here  we  shall  do  It  heurlstlcally. 

Let  P  elect  the  firing  probability  c,  to  be  fixed  later,  for 

the  second  move  of  F  .  If  E'e  second  move  la  leftwards,  P  fires 

r 

at  him  with  probability  r  and  then  hits  with  probability  a.  If  P 
does  not  fire,  the  situation  Is  tantamount  to  the  conanencement  of 

the  game  F,.  Assuming  that  P  also  strives  toward  his  upper  bound 

0 


The  reader  may  ask:  'Why  does  the  chancifylng  process 
lead  to  two  families  of  games  and  consequently  two 
functional  equations?  It  need  not;  see  Section  9* 
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when  pitying  this  latter  game,  the  hit  probability  under  theae 
clrcumatancea  ia 

ra  +  (l-r)f(c)  .  (4) 

If  E  chooaea  rlghtwirda  for  his  second  move,  the  hit  probability 
is  1  —  a  if  P  fires  Immediately.  If  P  does  not,  he  is  faced  with 
the  game  H  .  Itius  the  chance  of  a  hit  is 

r(l-a)  +  (l-r)h(c)  .  (5) 

Now  we  suppose  E  adroit  enough  so  that  his  left— right  choice 
asleots  the  minlsRia  of  (4)  and  (3).  Then  P,  to  play  well,  should 
pick  c  with  the  Intent  of  asking  this  mlnimua  as  large  ns  possibl 
Thus 

+  (l-r)f(c) 

f(r)  -  sup  min  <  .  (6) 

0^c<l  Ir(l-a)  +  (l-r)h(c) 

Similar  considerations  applied  to  lead  to 

f(l-r)f(d) 

h(r)  -  sup  min  J  .  (7) 

0^d<l  Ir(l-a)  +  (l-r)h(d) 

The  functions  f(r)  and  h(r)  appear  to  be  extraordinarily 
complicated.  It  seems  that  the  interval  0  <  r  <  1  is  to  be 
divided  into  infinitely  subintcrva’’ s  with  the  functions 
possessing  distinct  analytic  expressions  on  each.  Furthermore 
to  ascertain  these  expressions  appears  baffllngly  difficult. 
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llils  amazing  complexity  la  disconcerting  when  we  bear  In  mind 
that  we  are  still  dealing  with  but  one  of  the  almplest  versions 
of  our  problem. 

We  have  computed  plots  of  f  and  h  which  appear  at  the  end 
of  this  paper.  These  were  executed  with  naive  computational 
techinlques  out  with  enough  care  so  that,  If  date  Is  take  from 
the  plots,  they  will  fulfill  the  functional  equations  to  within 
the  limits  of  graphical  accuracy.  There  are  also  plots  of  the 
c  and  d  which  furnish  the  maxima. 

One  would  hardly  suspect  the  Involved  character  of  f  and  h 
from  their  Innocent  looking  graphs.  Are  we  to  conclude  that  there 
Is  some  simple  but  closely  approximate  method  of  treating  the 
present  class  of  problems?  We  do  not  know. 

RAND  Report  RNV-1385/  A  Qame  of  Aiming  and  Evasion;  Qeneral 
Discussion  and  the  Marksman *s  Strategies  Is  a  mathematically  more 
scrupulous  version  of  the  present  paper.  In  It  a  number  of 
properties  of  f  and  h  necessary  for  our  work  are  rigorously 
proved.  We  list  them  below.  If  the  reader  accepts  our  plots 
as  close  depictions  of  the  functions,  most  of  these  properties 
will  appear  obvious.  The  above  report  also  contains  a  rigorous 
derivation  of  the  functional  equations  (6)  and  (7). 

In  the  report  It  la  shown  that  all  solutions  of  (6)  and  (7) 
are  continuous.  Then  the  sup  appearing  on  their  right  sides  may 
be  replaced  by  max. 
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We  Introduce  the  numbere 
-  2V  ,  Rg  -  V 

and  use  R  to  mean  where  we  are  speaking  of  or  f  and  R,^ 

* 

when  speaking  of  or  h.  When  r  >  R  and  only  then  the 
functions  are  linear;  In  fact 

f (r)  -  a  ,  h(r)  -  a(l-r)  . 

The  largest  maximizers  here  are 

o(r)  -  min  [  ^ 

ff(r)  ■  min 

but  these  are  not  unique,  as  shown  by  the  shaded  portions  of 
plots  c  and  d.  Remark  that 

More  Interesting  Is  the  range  r  <  R.  Here  the  maximizing 
0  and  d  are  unique  for  each  r  and  will  be  denoted  by  c(r)  and 
d(r).  They  are  continuous  and 

c(r)  <  R^,  d(r)  <  Rg  . 

Further  f(r)  la  decreasing  and  h(r)  Increasing.  When 
0  -  c(r)[d  -  d(r)3  the  two  lines  on  the  left  of  (6)  [(7)]  have 
equal  values. 

« 

The  case  r  -  1  corresponds  to  certain  firing  and  so  no 
significance  then  attaches  to  c  or  d. 
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At  r  -  0,  f  and  h  are  differentiable  and 
f'(0)-A-l-2a 
h'(0)  .  -B  . 

Fiirt.her  c(0)  »  0,  c*(0)  exlata  and  -  V.  For  0  ^ 
there  exists  k  =>  k(r^)  such  that  c(r)  <  kr. 

We  shall  not  use  any  of  these  results  until  Section  4. 

It  Is  clear  from  (6)  and  (7)  that 

h(r)  <  f(r)  .  (0  <  r  ^  1)  (8) 

Also 

fr(c) 

f(0)  »  h(0)  ■  sup  min/  ■  sup  h(c)  (9) 

c  \^h(c)  c 

and  we  will  denote  the  conaaon  value  of  these  four  quantities  by  U. 

Consider  the  game  like  or  except  that  the  compulsion 
of  E's  first  move  Is  waived,  E  will  exploit  his  new  liberty  In 
favor  of  a  low  payoff;  from  (8),  the  sup  Inf  of  the  new  game  la 
h(r).  Now  put  r  -  0.  IVils  means  that  P  can't  fire  on  the  first 
move  and  so  the  game  virtually  starts  from  the  second.  It  Is  thus 
equivalent  to  our  original  game  In  all  ways  except  P's  constraint 
to  an  a— strategy.  Its  sup  Inf  Is  clearly  U.  Remark  th-^t  the 
election  of  an  o-etrategy  Is  at  P's  disposal;  thus.  In  playing 
the  original  game,  he  can  always  attain  a  hit  probability  arbi¬ 
trarily  close  to  U. 
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In  the  next  section  we  prove  thst  U  >  V.  As  we  already 
know  that  E,  by  pitying  M,  can  attain  a  payoff  <  V,  we  conclude 
that  V  lej  the  value  of  the  game. 

3 .  Ihe  Value  of  the  Game 
We  find 


a  -  . 447  . . .  ^  V 


and  so  U  >  a  Impllet  U  >  V,  which  cannot  be.  Hence  U  <  a. 

Let  be  the  set  of  all  pairs  a,  b  such  that  a  >  0  and  the 
Inequalities 

f(r)  >  U  +  ar  (10.1) 

h(r,''  >  U  -  br  (10.2) 


hold  for  all  sufficiently  small  positive  r.  Note  b  >  0  or  else 

tup  h(r)  would  exceed  h(0),  contradicting  (9). 
r 

Lenuaa  1.  ‘'j^ls  not  vacucus. 

Proof.  It  contains  the  pair  ^  (o-U),  a.  For*  If  r  >  0, 
we  put  c  -  0  In  (6)  and  then  d  -  0  in  (7): 


'ra+(l-r)U  •. 

f  (r)  >  min  {  »  ra  +  (l-r)U  -  U  r(a-U)  >  U  +  i  (a— U)r 

[r(l-a)+(l-r)U 


(l-r)U 

h(r)  >  min  I  ^U—  rU>U-ar. 

Ira+(l-r  )U 
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Lenraa  2.  If  a,  ht  so  does  a’,  b'  where 

s'  .l-a-U  -  (l-2a)  (11.1) 

b'  .  -  (l-a-U)  -I  (l-o)  .  (11.2) 


Proof !  Let  R  be  the  set  of  all  r  for  which  (10.1)  holds. 

In  (6),  If  we  restrict  the  range  of  c  to  R,  the  sup  cannot  Increase 
then  we  may  make  replacements  from  (10). 

r ra  +  (1-r )  (U-*-ac  ) 

f(r)  >  max  min  <  .  (12) 

c£R  Ir(l-a)  +  (l-r)(U— be) 


Hie  two  lines  on  the  ri^t  are  equal  when  c  -  c^; 

r  l-2a 

'o  *  1^7  rPB~  • 


As  the  upper  line  la  an  increasing  function  of  c,  and  the  lower 
one  decreasing,  c^  furnishes  the  max  providing  c^€R.  But  such 
is  the  case  when  hence  r, is  positive  and  sufficiently 

small.  When  c  -  c^  the  common  value  of  the  two  lines  in  (12)  is 

U  +  r  [l-o-U—  ( 1— 2a )]  =  U  a  '  r  . 


Treating  h(r)  analogously  leads  to 


r  1-a 


.-r  a+b 


h(r)  >  U  -  r  [-1-KI+U-*-  (1-a)] 


U  —  b  '  r 


Hie  underlying  idea  is  due  to  Oliver  Oross. 
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for  r  positive  and  amall. 

Finally 

a*  >l-a-U  -  (l-2a)  -  a  -  U  >  0  . 


Lenia  3.  U  >  V  . 

Proof.  Suppose  U  <  V.  We  will  show  that  If  ws  start  with 
any  member  of  and  construct  a  sequence  of  them  by  repeated 
appllcetiona  of  Lemma  2,  we  will  be  led  to  one  with  b  <  0. 

This  absurdity  gives  our  result. 


Let  a,  b,  a'«  b'  be  as  In  Lenma  2  and 


K  - 


b 

a+F  ' 


K' 


b' 


Addition  of  the  equations  (11)  gives 

^  -  a'  +  b'  -  aK  (14) 

while  (11.2)  yields 

K'  .  .  ^(K)  . 

We  show  that  Iteration  by  ^  will  ultimately  lead  to  a  K  <  0  and 
thus  a  b  <  0. 

First,  If  K  >  0,  then 


(^(K)  <  K  . 


(15) 
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For  (15)  l8  true  for  Bufflclently  small  positive  K  (then 
^(K)  <  0  <  K)  and  so  a  violation  of  (15)  would  Imply  a 
such  that 


l>!(K„)  - 

or 

aK^  -  (l-a)K^  +  (l-a-U)  -  0  .  (16) 

But  the  discriminant  of  this  quadratic  it 

(1-a)^  -  4a(l-ci-U)  -  2  -  6a  +  4aU  -  4a(U-  ^3^)  .  4a(U-V)  <  0 

Secondly  suppose,  starting  with  any  value,  all  the  iterates 
of  i  were  positive.  By  (15)  they  are  decreasing  and  so  converge, 
llie  limit  would  be  a  root  of  (16). 

Theorem  1.  The  value  of  the  game  Is  V. 

Proof.  As  in  the  last  few  paragraphs  of  Section  2. 

Corollary  1.1.  U  V 

Corollary  1.2.  For  each  £  >  0,  there  is  an  ^-strategy  for  P 
which  is  an  o-atrategy. 

llils  corollary  solves  half  the  problem  of  the  marksman's  best 
strategies.  We  now  know  how  he  Is  to  aim;  the  remaining  question 
la  when  Is  he  to  fire.  For  a  further  discussion  of  the  a— strategies 


see  Section  7. 
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The  work  of  Scarf  and  Shapley  in  [4^  tella  that  E  has  an 

optimal  strategy  for  all  r  for  both  F  and  H  and  that  these 

r  r 

games  have  values.  It  follows,  frow  the  general  principles  of 
game  theory,  that  the  values  must  be  f(r)  and  h(r). 

4.  The  Ideal  Strategies  for  P 

We  deal  with  the  games  and  They  have  the  advantage 

of  reducing  P's  decisions  to  choices  only  of  when  to  fire.  As 
discussed  earlier,  his  near  optimal  strategies  for  these  games 
suffice  to  yield  at  least  some  such  strategies  for  our  subject 
game.  We  will  see  later  that  this  yield  is  more  consummate  than 
at  first  appears. 

Assume  f(r)  and  h(r)  have  been  ascertained.  How  do  thej 

function  in  determining  P's  strategy?  Consider  P's  situation 

in  a  play  of,  say,  F^.  He  has  no  choice  as  to  his  first  firing 

probability,  it  being  r  (which  we  shall  also  call  r^).  The 

derivation  of  the  functional  equation  (o)  makes  it  plausible 

that  his  next  firing  probability  will  be  a  value  of  c  which 

furnishes  a  maximum  to  the  right  side.  Select  such  a  value  and 

call  it  r^.  Suppose  E's  next  move  Is  straight.  Ihen,  if  P  has 

not  yet  fired,  he  la  new  faced  with  the  game  H  .  By  the  same 

^1 

reasoning  as  befor  ,  a  sensible  choice  for  his  next  firing 
probability  will  be  a  maximizing  d  of  (7)  witn  r  =  r^ .  Select 
one  such  and  label  la  r^.  Proceed  thus.  we  will  denote  the 
strategies  so  generated  (for  as  well  as  F^)  collectively 
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by  Q.  It  is  clear  that  If  P  has  an  optimal  strategy  It  must 
belong  to  Q.  If  he  has  not  —  as  aeema  more  likely  —  what 
la  the  role  of  Q? 

At  the  conclusion  of  thla  paper  will  be  found  plots  of  c(r) 
and  d(r),  the  maximising  c  and  d  of  (6)  and  (?)•  Playing  Q  amounts 
to  succeaalvely  iterating  the  rj  from  these  curves  using  the  c  or  d 
one  according  as  E'a  last  move  was  a  atral^t  or  a  turn. 

We  now  exaialnc  a  typical  play.  Suppose 
moves  as  shown  In  Figure  7  and  that  P  plays  Q, 
obtaining  the  firing  probabilities  as  shown. 

Put 

n 

V  -  IT  (1-rJ  , 

J-0 

the  probability  that  P  has  not  fired  at  the 
first  n  +  1  opportunities.  For  convenience, 
we  also  define  Tr_^  as  1.  Then  the  proba¬ 
bility  of  a  hit  In  thla  play  la 

From  the  way  In  which  the  r^  were  selected,  we  have 


*  Here  and  In  later  Illustrations,  E  plays  a  pure  strategy. 
Such  suffices,  for  If  P  can  overcome  all  pure  strategies 
of  E  hm  can  overcoats  a  mixture. 
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|r^a+(l-r^)f(r^) 

|^r^(l-a)-»-(l-ro)h(ri) 


r(ro) 


min 


(l-r^)f (r^) 


r^(l-a)  +  (l-r^  )h(r2) 


) 


min 


(l-r2)f  (r^) 

ro(l-a)  +  (l-r^)h(r,  ) 


h(r^) 


min 


r^a+(l-r.^)f(r^) 

ir^(l-a)4-(l-r^)h(r|^) 


r{r^) 


(18) 


and  with  none  but  a  Q  strategy  could  these  equalities  be  attained. 
By  a  Judicious  selection  of  one  of  the  lines  on  each  left  side,  we 
obtain  from  (l8)j 


r^^(l-a)  +  (l-r^)h(r^)  >  f(r^) 
r^(l-a)  +  (l-r^}h(r2)  >  h(r^) 
(l-r2)f(r^)  >  hir^) 

r^a  +  (l-r^)f(rj^)  >  f(r^) 


(19) 


01  earranged  and  multiplied  by  the 
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7i_^r^(l-a)  >  -  Tj^h(r^) 

7r^r^(l-a)  >Tr^h(r^)  -i,^h{r^) 

0  >  T/^h  (r^)  - 

^2^^^  ^  '^2  ^  ^^3^  ~ 


(20) 


The below  are  the  truncations  of  (17).  Prom  (20) 

>^l  k.  ^(^)  “  7;^h(r2) 

^  r(r)  -  i^r{r^) 

or  In  general 

'^n  ^  ^^^n+1^^  ' 

We  now  see  at  once 

'Hieorem  2.  A  sufficient  condition  that  a  Q  strategy  attain 


the  best  possible  value  for  P  In  a  particular  play  Is 
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Llm  TT  -  0  .  (22) 

n  00 

lYils  condition  will  be  met  should  any  -  1  (certain 

firing).  Otherwise  —  as  Is  well  known  —  It  Is  tantamount  to 

oo 

the  divergence  of  Z  r.  . 

J-0  ^ 

TTieorem  3*  If  P  has  an  optimal  strategy  at  all,  It  must  be 
a  strategy  Q. 

Proof:  Suppose  P  plays  a  strategy  not  Q.  Then  In  at  least 
one  of  (18)  the  sign  »  becomes  <.  Let  E  move  straight  or  turn  on 
each  move  according  as  the  upper  or  lower  line  on  the  left  side  of 
the  corresponding  (18)  Is  the  smaller  (either  way  In  the  case  of 
equality).  Then  In  (19)»  >  is  replaced  by  -  or  <  ,  with  at  least 
one  Instance  of  the  latter.  Thus  >  Is  replaced  by  <  In  (21)  for 
all  large  n.  • 

Theorem  4.  If  r  <  R,  then  ?  has  no  optimal  strategy. 

Proof.  Let  P  play  Q.  For  r  <  R,  the  signs  <  of  (19)  become  - 
and  the  same  Is  true  (21).  Thus  (22)  is  a  necessary  as  well  as  a 
sufficient  condition. 

Let  V4  take  the  case  of  F^.  Let  E  make  all  straight  moves. 

Then 


•■j+i  -  i 


and  so 
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rj  < 


•nd  ao  ZTj  convargaa. 

For  Hj.,  lat  E  pick  atral^t  for  his  first  free  move.  Than  P 
la  confrontad  by  H_  with  r,  <  Ri ,  and  wa  ravart  to  tha  pracadlng 

Tj  1  i 

oaaa. 


Theorem  3.  If  r  >  R,  then  any  atrategy  Q  la  optimal. 


Proof.  Here  Tj  >  Rj^  and  so  Zr^  diverges, 


Remark.  Tha  moat  efficient  strategy  Q  utilises  tha  functions 

t 

c(r)  and  3r(r).  If  r  >  R,  It  Is  not  hard  to  see  that  finitely  many 
Iterations^  at  each  stage  by  one  or  tha  other  of  these  funotlonSj 
will  lead  to  an  r^  -  1,  thus  temlnatlng  tha  play. 

If  r  =  R,  Corollary  9-1  shows  that  E  makes  all 

stral^t  moves  henceforth,  all  the  remaining  "nils  Is  tha 

only  Instance  where  Q  Is  optimal,  yet  cannot  be  made  finite. 


The  role  of  Q  now  emerges.  Aside  from  the  uninteresting  cases 
of  larger  r,  Q  Is  unique  and  not  optimal,  and  Indeed  there  Is  none 
such.  If  P  deviates  appreciably  from  Q,  the  Inequalities,  ahloh 
at  least  some  of  (18)  become,  will  be  severe.  Their  coeq>ensatlon 
by  (19)  can  be  frustrated  by  E,  because  his  moves  decide  Which 
line  on  the  left  of  (18)  Is  to  be  effective.  The  result  will  be 
a  payoff  appreciably  defective.  We  draw  the  following  rough  con¬ 
clusion  (these  Ideas  will  be  dissected  with  more  precision  In  the 
next  section): 


P-642 

-26- 


In  general  P  hai  no  optlnal  atrategy,  but  any  a tra tegy 
must  be  cloae  to  Q,  the  cloaeneas  increasing  »fith  the  amallneea 
of  £  . 

It  seems  apt  to  term  a  strategy  with  this  property  an  Ideal 
strategy.  A  precise  statement  Is  made  by  Theorem  7  below. 


6.  The  Passive  6 -Strategics 


The  case  r  -  0  Is  really  our  desideratum,  for  as  we  have  seen 
In  Section  2,  it  la,  aside  from  the  restriction  to  a— strategies, 
the  original  subject  game.  The  strategy  Q  for  It  leads  to  the 
vapid  situation:  all  the  r^  -  0;  P  never  fires. 

We  now  turn  to  C-etrategles,  taking  some  positive  £  as  given, 

with  P  seeking  a  payoff  >  V  -  € .  The  ^  gives  him  license  to  depart 

from  the  sterility  of  the  all  zero  r^.  Thus  It  Is  that  we  find 

use  for  and  with  r  0. 
r  r 

Our  procedure  Is  a  recurrent  one,  somewhat  like  that  of  the 
last  section.  But  not  only  will  P  ascertain  an  from  r^,  but 

also  an  from  iy  This  8^  Is  that  circumscription  on  the  J 

move  permitted  him  by  the  preassigned  £  -  of  the  outset. 

Let  iij  be  E's  J^^  move  (J  -  0.  1,  2,  •••  so  taken  that  m^ 

Is  the  preassigned  move  Indigenous  to  the  game);  m^  -  either 
"Straight"  or  "Turn."  The  quantities  r^  -  r,  -  £  >  0,  and 
(deciding  between  and  H^)  are  given  at  the  outset.  At  a 


th 
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later  stage,  these  will  be  known  (of  course,  assuming  P  has  not 
yet  fired ) : 


3 

O 

^0^ 

^1' 

Tj 

£o> 

^1> 

■■■’  • 

It  la  now  time  for  P  to  select  will  aay  he  is 

playing  a  strategy  if  he  does  so  as  follows  for  each  J  /  0: 

1)  If  Tj  y  R,  he  plays  a  strategy  Q  from  this  point  on. 

Here  means  Rn  if  m.  was  Straight  and  if  m.  was  Turn. 

1  j  ^  2  J 

2)  If  Tj  <  H  he  picks  so  that,  if  was  Straight 


r  .a+(l-r , )f  (r,  -  ) 


min 


j 


j 


j+i 


rj(l^)  +  (l-rj)h(rj^J 


>  f(r,)  -  £ 


(2?) 


and  utilizes  a  corresponding  inequality,  which  the  reader  will 
readily  infer,  if  was  'fum. 

If  P  has  not  yet  fired,  E  now  picks 

If  Case  I  held,  P  will  have  no  need  of  further  €.,  but  if 
II  held,  must  be  defined.  Suppose,  for  example, 

Purn.  Ilien  we  take 

S+l  -  -  h(c(rj))  +  .  (2-*) 

Therp  la  an  analogous  equation  for  each  of  the  other  three 
possibilities  of  my  . 
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Ihe  cycle  Is  ready  for  repetition. 

We  must  show  that  this  process  can  be  effected.  First, 
the  obtained  will  always  be  positive.  In  the  Instance 
displayed  above  ((23)  and  (24)),  we  know  from  the  functional 
equation  that 


rj(l^)  (l-rj)h(c(rj) )  -  f(rj)  .  (25) 


Ihe  combination  of  (25)  and  (23),  using  the  lower  line  on  the 
left,  will  show  that  the  right  side  of  (24)  is  positive.  If 
£  >  0,  by  Induction,  all  the  appearing  will  be  positive. 

We  observe  that  if  Case  I  arises  once,  it  does  so  thereafter. 
Finally,  we  see  that  an  can  always  be  found  satisfying 

(23) (or  its  analogue),  for  c(rj)  is  one  such. 

We  now  turn  to  the  the  hit  probabilities  for  a  finite 
segment  of  initial  stages,  and  handle  them  as  we  did  in  the 
previous  section.  Like  (17)  we  find 


n— 1 
Z 

J-0 


(26) 


where  a^  is  a,  1  —  a,  or  0  according  to  the  values  of  the  pair 
mj,  If  suppose  that  Case  II  has  held  thus  far  and 

proceed  in  a  manner  similar  to  the  derivation  of  (21),  we  obtain 


n— 1 


r 

( 

r  n 

f(r)  or  h(r) 

f  (r  )  or  h  (r  ) 
n '  n  ^  n '  n  _ 

-  £  : 
n 

J 

(27) 


Recall  that  P's  objective  is  to  obtain  a  payoff  exceeding 
the  first  two  terms  on  the  right  of  (27).  'What  (27)  states  la 
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this:  If  the  play  la  Interrupted  so  that  P  la  confronted  with 

F  or  H  .  he  can  attain  hla  objective  according  ae  he  obtalna 
^n  ^n 

In  the  new  aubgame  a  payoff  exceeding  Ita  value  leaa 

Froai  the  Initiation  the  reader  had  In  the  laat  aectlon,  he 
ahould  have  no  trouble  In  oceqpletlng  the  proof  of 

■nieorea  6.  Let  P  play  Qj  .  If  at  any  tlae  Caae  I  arlaea, 
then  P  will  attain  hie  objective;  If  It  doea  not,  P,  after  any 
finite  nuaber  of  novea,  will  be  In  a  position  such  that  It  la 
possible  for  him  to  attain  hla  objective.  On  the  other  hand,  if 
at  any  time,  when  faced  with  Case  II,  P  aeleota  hie  firing 
probability  In  violation  of  (23),  then  E  can  prevent  him  from 
attaining  hla  objective. 

IhlB  theorem  exposes  the  nature  of  Q^.  We,  of  course,  suppose 
r  <  R.  Then,  as  long  aa  Case  II  pereiats,  we  have  eeen  that  P  la 
compelled  to  abide  by  In  order  to  play  an  £-etrategy.  But  the 
latter  desideratum  Is  by  no  means  guaranteed.  For  example,  we 
see  that  Q  Is  a  strategy  for  every  £  >  0.  But  we  know  Q  la  not 
optimal;  hence  It  la  not  an  €-etrategy  If  C  Is  sufficiently  small. 
On  the  other  hand,  as  long  as  P  adheres  to  he  Is  safe.  In  that 
he  has  not  forfeited  the  possibility  of  exceeding  (value  -  £ )  as 
the  payoff. 

His  situation  Is  much  like  that  of  a  person  asked  to  select 
the  terms  of  Infinite  series  one  at  a  time  In  such  a  way  that  the 
series  converges.  After  each  Individual  selection  the  possibility 
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of  convergence  has  not  been  destroyed.  But  this  does  not  mean 
that  the  entire  aggregate  of  selections  will  spell  convergence. 

We  term  a  strategy  with  the  above  properties  a  pasalve 
E-atrategy. 

We  conclude  with  a  sharp  statement  that  Q  Is  an  Ideal 
strategy  but  omit  the  proof.  In  case  r  >  R  the  strategies  Q 
(and  only  they)  are  actually  optimal  and  nothing  more  need  be 
said.  We  assume  r  <  R.  In  this  case  we  know  that  Q  la  unique. 

We  wish  to  establish  a  measure  of  the  closeness  of  two 
strategies.  Suppose  E  adheres  to  some  pure  strategsy  In  a 
particular  play.  Any  mixed  strategy  U  of  P  will  result  In  a 
sequence  of  firing  probabilities  ^r^  -  r,  r^^,  rg,  ***}•  * 

second  strategy  U',  let  the  sequence  be  |r^  -  r^  -  r,  r^,  r^,  •• 
We  define 


U' )  -  max  |r.  -  rj  | 

and  U')  by  max  d^  over  all  pure  strategies  of  E.* 

Theorem  7>  Given  r  <  R  and  one  of  F_.  H_.  as  well  as  an 
■  "  r  r 

Integer  n  >  0  and  8  >  0,  then  we  can  find  i  -  n)  so  that 

If  U  la  E -strategy  for  P  with  £  <  T  then 

Dn(Q,  U)  <  8  . 


Of  course,  we  need  consider  only  E's  first  n  moves 
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6.  me  6 -Strategies;  The  Unsolved  Margin 

We  know  that  for  P  to  play  an  £-Btrategy  with  a  small  £  he 

must  remain  In  the  vicinity  of  a  strategy  Q^.  But  exactly  how 

this  should  be  done  Is  still  an  open  question.  The  following 
theorem  and  more  particularly  Its  corollary  offer  a  lead. 

t 

Theorem  8.  An  6-strategy  can  be  executed  In  a  finite 
number  of  moves. 

Proof.  If  r  >  R,  -  Q  and  we  know  the  latter  terminate 
In  finitely  many  moves.  If  r  <  R,  the  €— strategy  begins  with 

Case  II  and  la  thus  Qg.  If  It  switches  to  Case  I  It  can  be 

terminated.  If  not,  we  see  by  (27)  that  P  can  exceed  e^(r)  -g 
only  If  for  some  n,  e^(r^)  -  £„  <  0*  But  this  means  the  desired 
hit  probability  has  been  achieved  In  finitely  many  moves.  Thus 
the  ensuing  r^  are  Irrelevant;  we  can  take  one  of  them  -  1.  (This 
strange  situation  can  happen.  For  example.  It  happens  st  the  vexv 
outset  If  E  Is  taken  absurdly  large. )  The  only  remaining  case  — 
the  rj  stay  Rj^  and  E  plays  all  straights  —  seems  unimportant. 

No  doubt,  P  can  Increase  Rj^  a  mite  and  take  a  small  loss  (<  £) 

In  payoff. 

Corollary  8.  Every  play  In  which  P  employs  an  C-strategy 
can  be  culminated  with  an  r^  •  1. 

A  necessary  condition  for  a  strategy  Qg  not  to  stagnate  then 
Is  that  we  find  some  means  of  avoiding  peralstenly  small  r^. 
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To  see  what  happens  should  the  rj(and  also  the  £j)  remain 
small,  we  mi^t  use  linear  approximations  of  f  and  h.  Prom 
Section  2  these  turn  out  to  be 

f(r)  -  V  +  Ar 
h(r)  *  V  -  Br  . 

The  expressions  on  the  rl^t  actually  are  formal  solutions 
to  the  functlonsl  equations  with  the  maxloilzers 


(Ihe  first  of  these  la  corroborated  by  Section  2.) 
However,  we  will  linearise  to  the  full  and  use 

c(r)  »  vr 
d(r)  -  2r  . 

Let  be  c  If  m^  -  Stral^t  and  d  If  mj  -  Turn. 

Now  the  basic  Inequality  (23)  of  Qg  condemns  r^^j^  to  an 
Interval  containing  7j(rj).  We  know  that  use  of  7j(rj)  Itself 
for  r.  ..  Is  Q  and  not  even  close  to  optimal.  In  fact  It  falls 
because  the  rj  can  remain  small  (Theorem  4  and  Its  proof). 
Therefore  It  seems  sensible  always  to  take  the  part  of 

the  prescribed  Interval  lying  to  the  right  of 
be  the  fraction  of  (**j+i-7j(rj) )/(rj^j^-7j(rj) )  where  Is 
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the  rl^t  boundary  of  the  Interval.  The  task  of  P  reduces  to 
selecting  the  kj.  Using  the  approximations  (50)  and  (52),  the 
governing  equations  are  found  to  be 

*'j+l  “  ■*’  B 

»*iere  bj  -  V  if  is  straight  and  2  If  m^  la  turn.  We  start 
with  a  given  small  r^,  and  co!iq>ute  the  later  ones  recurrently 
by  (55),  each  time  selecting  kj(0  <  kj  <  1).  At  the  same  time  E 

Is  selecting  the  m^.  Vtoen  we  apply  (55)  ■o»  ®i*  •••»  *j  ii 
known,  but  not  Thus  the  value  of  bj^j^  la  unknown  idien 

k  la  chosen.  In  brief,  the  order  of  choices  and  cos^utatlonB 

J 

Is 


“o'  ^o'  ^o  -  8^^®" 
kp  chosen  by  P 

r^  ooeq>uted 

nij^  chosen  by  E  (deciding  bj^) 
computed 
kj^  chosen  by  P 
Tg  computed 


etc. 
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Itie  problem:  To  devise  a  scheme  for  selecting  the  kj  so 
that  no  matter  how  E  picks  the  the  r^  will  not  remain  small 

We  have  been  unable  to  solve  It. 


At  the  least,  the  solution  will  point  the  way  to  6— etrategl 
Very  likely,  after  developing  some  results  that  would  furnish 
bounds  to  errors  arising  from  (30)  and  (32),  It  would  actually 
supply  the  £-atrateglea .  Ilierc  exists  an  exact  version  of  (33) 
but,  due  to  the  complicated  nature  of  f  and  h.  It  would  be 
difficult  to  write  the  right  sides  explicitly.  Remark  that 
our  previous  results  guarantee  that  the  problem  has  a  solution. 


7.  Motivation  for  the  u-a trategles 

Let  us  consider  a  miniature  game  In  ’which  P  has  but  one 
chance  to  fire  and  three  choices  of  where  to  aim.  He  uses  a 


Figure  8  . 


mixed  strategy  taking  a,  b,  c  as  the  probabilities  as  shown  In 
Figure  8.  As  for  E,  he  makes  Just  two  moves  and  each  of  these 
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wlth  probability  6  for  a  tumj  he  doea  nought  but  aalaot  e. 
There  la  flotltloua  ■ove  preceding  the  flrat  ao  that  atralght 
and  turn  aay  be  dlatlngulahed  there. 

The  payoff  la 

«(l_e)^+  eb  ©(l-G)o  . 

The  coafljutatlon  la  oad.tted,  but  the  aolutlon  la 

opt.  atrat.  for  P:  a-a,  b-l-a,  c-0 


opt.  atrat.  for  E:  0  -  V 


Value  t  V  . 


I  It  followa  that  If  In  the  original  gaae  we  wlah  to  fix  the 

aiming  probabllltlea  at  all,  they  can  only  be  fixed  at  the  raluea 
above.  For  otherwlae  E  could  find  a  G  In  the  little  game  render¬ 
ing  him  a  payoff  <  V.  In  the  original  game,  then,  E  could  play  a 
atrategy  like  M  but  ualng  thla  ©  inatead  of  V  and  attain  the  aame 

payoff. 

I  Let  ua  bear  In  mind  that  generally  the  parametera  entailed  In 

!  an  fc-atrategy  are  not  aharply  delineated.  For  the  player  may  chooae 
to  play  an  e'-atrategy  with  t'  <  £ •  He  can  exploit  the  margin 
I  In  payoff  by  slight  alterations  in  the  quantities  he  controls. 

Applying  this  principle  to  our  case,  we  see  that  ^  will  have 
f^trategles  that  are  not  (^-strategies  but  close  to  <j-t.trateglea. 

Has  he  any  that  are  not  close?  If  the  answer  Is  no,  as  seems 
likely,  the  following  conjecture  seems  reasonable. 
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Con Jeciure  —  Q  la  an  Ideal  a‘  raiegy  not  only  among  the 
a— 3 tra cegiea  but  among  all  the  strateglea  of  P. 

8.  Ihe  I'runcated  Veralons 

We  can  apply  a  technique  here  that  proved  useful  in  [2]  ; 

we  amend  the  rulea  by  requiring  that  P  can  fire  only  on  the 

first  n  moves.  Ihe  max  rain  functions  will  be  replaced  by 
f^(r)  and  h^(r).  Ihe  functional  equations  (6)  and  (7)  become 
recurrence  relations;  we  affix  to  each  f  or  h  the  subscript 
n  1  when  It  appears  on  the  left  side  and  n  when  It  appears 

on  the  right.  We  may  take  f^(r)  and  h^(r)  as  0;  all  the 

functions  are  then  determined  recurrently. 

We  may  proceed  as  in  [2].  The  truncated  games  fall  under 
the  general  tenets  of  game  theory  and  we  Know  at  once  that 
both  players  have  optimal  strategies.  'Ihe  functions  f^(r), 
h^(r)  Increase  with  n,  for  P  can  apply  an  optimal  strategy 
for  the  case  with  a  small  n  to  the  case  with  a  larger,  filling 
In  the  residual  moves  arbitrarily.  The  proof  of  Lemma  5  Is 
easily  modified  to  show  that  the  and  h^(r)  are  equl- 

contlnuous.  Ihus  the  converge  uniformly  to 

f(r)  [h(r)]. 

One  conclusion  is  evident: 

rhcorem  9*  An  strategy  can  be  found  which  terminates 
In  n  moves,  the  n  depending  only  on  C  . 


of  RM-I385 
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9.  The  Q<ner»l  "Chanclfied”  Qa—  and  Funotional  EquatlCTi 

We  now  relinqfuleh  P's  constraint  to  o-strstesles.  We 
chsnolfy  as  follows:  P  shall  fire  initially  with  probability  r 
and  his  slmlng  probabilities  shall  be  as  shown  In  Figure  (8). 

As  before,  a  fictitious  pre— Initial  move  Is  requisite.  It  Is 
required  that  E  make  his  Initial  move  straight  (to  the  left  In 
Figure  8).  The  max  min  (or  value)  we  denote  by  ^(r,  a,  b). 


/ 

/ 

/ 


Figure  9 


If  we  demand  E  make  a  turn  Initially,  the  c on ^spending 
function  Is  ^(r,  b,  a).  The  functional  equation  for  ^  Is 
derived  along  lines  we  have  seen  before;  It  Is 

,  fra  +(l-r)^(c,x,y) 

p(r,a,b}  >  max  min < 

o,x,  y  (^r(l-a-b)+(l-r)^(o,y,x) 

Here  the  maxlmlsers  are  of  course  subject  to 

0<c<l,  x>0,  y>0,  x+y<l  . 
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lYie  connection  with  our  earlier  work  lies  In 
f(r)  -  ^(r,a,0}  ,  h(r)  -  ^(r,0,a) 


and  In  these  special  cases  (34)  reduces  to  (6)  or  (j). 
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